Papers with low-resource learning
CEAN: Contrastive Event Aggregation Network with LLM-based Augmentation for Event Extraction (2024.eacl-long)
Copied to clipboard
| Challenge: | Event Extraction is a crucial yet arduous task in natural language processing (NLP), as its performance is hindered by laborious data annotation. |
| Approach: | They propose a Contrastive Event Aggregation Network with LLM-based Augmentation to promote low-resource learning and reduce data noise for event extraction. |
| Outcome: | The proposed approach achieves new state-of-the-art results on the ACE2005 and ERE-EN datasets. |
Achilles-Bench: A Challenging Benchmark for Low-Resource Evaluation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing low-resource datasets that challenge neural networks cause over-estimated performance, despite promising yet saturated results in high-res settings. |
| Approach: | They propose a benchmark Achilles-Bench to better evaluate the learning ability of neural networks in low-resource settings. |
| Outcome: | The proposed benchmarks show that even pre-trained language models show performance drops on NLP tasks. |
Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies show that results from high-resource languages cannot be easily transferred to realistic, low-resourced scenarios. |
| Approach: | They analyse performance of multilingual transformer models using available resources for Hausa, isiXhosa and NER and topic classification. |
| Outcome: | The proposed models can achieve with as little as 10 or 100 labeled sentences the same performance as baselines with much more supervised training data. |